MRC  Technical  Summary  Report  # 1826 


A FUBINl  THEOREM  FOR  ITERATED 
STOCHASTIC  INTEGRALS 


Marc  A.  Berger 


Mathematics  Research  Center 
University  of  Wisconsin— Madison 
610  Walnut  Street 
Madison,  Wisconsin  53706 


February  1978 


(Received  December  5,  1977) 


D D C 

ifaEmoD 


Approved  for  public  release 
Distribution  unlimited 


Sponsored  by 

U.S.  Army  Research  Office 
P.  O.  Box  12211 
Research  Triangle  Park 
North  Carolina  27709 


National  Science  Foundation 
Washington,  D.  C. 

20550 


UNIVERSITY  OF  WISCONSIN  - MADISON 
MATHEMATICS  RESEARCH  CENTER 


A FUBINI  THEOREM  FOR  ITERATED  STOCHASTIC  INTEGRALS  I 

Marc  A.  Berger  ; 

k 

t 

I 

Technical  Suiranary  Report  #1826  I 

February  1978  i 

i 

ABSTRACT  > 

I 

This  report  extends  the  stochastic  integral  of  Ito  to  allow  for  a certain  I 

class  of  anticipating  integrands.  Probcibilistic  and  computational  results  con- 
cerning this  extension  are  presented.  And  iterated  integrals  are  discussed. 

The  motivation  for  this  extension  stems  from  the  Ito-Volterra  eguation. 

This  eguation  arises  from  feedback  in  the  presence  of  white  noise,  and  cannot 
be  inverted  using  classical  stochastic  integrals.  The  inversion  involving  the 
extended  integrals  appears  at  the  end  of  the  report. 


Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-75-C-0024  and  by 
the  National  Science  Foundation  under  Grant  No.  MCS75-17385  AOl. 


SIGNIFICANCE  AND  EXPLANATION 


In  the  analysis  of  feedback  systems  such  as  coupled  electrical  circuitry 
and  economic  life  cycles,  one  is  led  to  consider  diagrams  such  as  the  one  shown 
below.  The  box  T sianifies  a transfer  from  the  input  F (e.g.  current,  in- 
come) to  the  output  f, . Junction  J is  a step-up  or  step-down  point.  Here 
either  some  fraction  of  C is  diverted  for  external  consumption,  or  else  C 
is  scaled  up.  And  the  remainder  in  the  loop  C/  along  with  an  external  driving 
force  E , is  used  to  drive  the  process. 


If  the  junction  J involves  a white  noise  (e.g.  thermal  noise,  stock  plans) 
then  the  equation  governing  the  process  involves  a stochastic  integral  which 
cannot  be  inverted  using  the  classical  theory  of  stochastic  integration.  Thus 
the  equation  cannot  be  solved  for  f; . 

This  report  discusses  the  construction  of  an  extension  for  the  classical 
stochastic  integral,  designed  to  overcome  the  above  limitation.  Included  are 
properties  of  this  extension,  and  the  subject  of  iterated  stochastic  integration. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  v;it)i  MFC,  and  not  with  the  author  of  this  report. 
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A FUBINI  THEOREM  FOR  ITERATED  STOCHASTIC  INTEGRALS 


Marc  A.  Berger 

§1.  INTRODUCTION 

Shown  in  the  figure  below  is  a typical  feedback  diagram.  The  box  T signifies  a trans- 
fer from  the  input  F to  the  output  £,  For  example, 

t 

(l-l)  ?(t)  » / 0(t-T)F(T)dT  , t ^ 0 

0 

Junction  J is  a step-up  or  step-down  point.  Here  either  some  fraction  of  C is  diverted 
for  external  consumption. 


/ \ 

U- 


or  else  C is  scaled  up.  Thus  the  remainder  in  the  loop  is 

(1.2)  C = aC  . 

If  the  process  uses  this  remainder  ^ to  drive  itself,  along  with  an  external  driving  force 
E,  then 

(1.3)  F = E + C . 

Combining  (I.l),  (1.2),  (1.3)  it  follows  that  the  equation  governing  the  system  is 

t t 

(l.'l)  f,(t)  - / 0(t-T)a(T)  5(T)dT  = / 0(t-T)E(T)dT,  t ' 0 . 

0 0 

Suppose,  however,  that  a is  in  the  form  of  a noise 

Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-75-C-(l024  and  bv  the  National 
Science  Foundation  under  Grant  No.  MCS75-173a5  AOl. 
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a s a + a z 
1 2 


where  z is  a white  noise.  Then  (1.4)  becomes 


t t 

t(t)  - / o(t-T)a,  (T)C(T)dT  - / 0(t-T)ci_(T)C(T)dB(T) 

0 0 

(1.6)  ^ 

= / ot-T)E(T)dT,  6 0 

0 

where  B is  a Brownian  motion 

t 

(1.7)  6(t)  » / z(T)dT  , t > 0 . 

0 

This  equation  is  an  Ito-Volterra  equation,  the  class  of  which  is  discussed  in  55.  The 

difficulty  lies  in  the  inability  to  represent  the  iterates  of  the  operator 

t 

(1.8)  Tf{t)  « / a(t-T)a  (T)f(T)dB(T)  , t 0 

0 ^ 

in  a similar  form.  And  this  is  precisely  because  the  integrand  in  a stochastic  integral  must 

be  nonanticipatinq.  Thus  there  is  no  meaning  to  an  integral  li)5e 
t t 

(1.9)  / [/  a(t-Tj^)o(T^-T)a2t7j^)dB(Tj^)]a2(T)f(T)dB(T) 

0 T 

Ito  (8)  has  defined  an  integral 

t t 

I(t)  ' / / g(T,  ,T2)dB(Tj^)dB(T2) 

0 0 

2 

where  g t L ( [0,t)  x (0,tl).  His  definition  there  is 

t '^2 

(1.10)  I(t)  =/  / Ig(T,,T2)  + g(T2.T,)]d6(Tj^)dB(T2)  . t^O  . 

0 0 

This  integral  behaves  in  many  ways  li)«e  a single  stochastic  integral,  but  not  li)te  two 

iterated  integrals.  For  example, 
t t 

/ / <5(T.)l))(T_)dB(T.)d6(T2) 

0 0^ 

(1.11) 

t t t 

* (/  i(i(T)d6(T)]  ij  i)i(T)d6(T)]  - / iti(T)i|;(T)dT,  t ^ 0 
0 0 0 

for  ( L^((0,tl).  Thus,  although  according  to  (1.10)  the  natural  definition  for  integrals 

lilce  (1.9)  should  be 
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(1.12) 


t t 

/ / g(T,T  ,t)d8(T  )de(T) 

0 » ‘ ^ 

t T 

* / / g ( T , . ' . t ) d6  (t.  ) d6  (t  ) , t ^0 

0 0 * ^ 


tlnis  has  the  disadvantage  that  it  really  is  a two-dimensional  integral,  but  not  an  iterated 
one-dimcnsional  integral. 

To  this  end  we  present  an  extension  of  the  stochastic  integral  which  allows  one  to  solve 
equations  lilte  (1.6)  by  iterating  operators  lilte  (1.8).  This  extension  is,  roughly  speaking, 
the  unique  extension  which  allows  integrals  to  be  iterated  one  variable  at  a time,  in  the 

usual  fashion.  Thus,  for  example,  a formula  like  (1.11)  becomes 

t t 

/ / 4.(1  )i(/(t  )d8(T  )d8(T  ) 

n o ^ ^ ^ 

(1.13)  ^ ^ 

t t 

= (/  (^(T)dB  (t)  It/  t|;(T)d6(T)) 

0 0 

The  distinction  between  our  integral  and  that  of  Ito  is  clarified  through  the  Correction 
Formula  (Theorem  3. A).  Because  of  the  ease  of  the  calculations  ensuing  from  our  integral, 
many  properties  of  stochastic  calculus  are  revealed.  For  example,  in  §3  we  present  the 
Doob-.Meyer  decomposition  for  a class  of  nonanticipating  processes.  And  we  also  present  there 
a discussion  of  integrals 

t 

/ 8(X(T))d8(T) 

0 

where  X(t)  ^ t.  And  in  Theorem  4.B  we  provide  a differentiation  rule  for  processes 

C(t)  = F(t,8(t) ) , t > 0 

where 

t 

F(t,x)  = / (ji  (t  , t ,x-6  (t  ) ) d8  (t  ) , t ^ 0 : X f R 

0 

For  a different  approach  to  the  Correction  Formula  the  reader  is  referred  to  Meyer  (111 
pp.  321-326.  And  for  other  types  of  random  integral  operators,  Bharucha-Re id  14)  and  Tsokos 
and  Padgett  (13)  are  quite  comprehensive. 


I 
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2.  M;OT^D_jTOCHASTIC  INTEGRAL 

Let  <n,3,F)  be  a probeibility  space,  and  l6(t):t  >^0)  a Brownian  motion  on  it.  For 

0 £ tj^  £ t^  let  denote  the  sub-siqma-alqebra  of  ^ generated  by 

{B(T)-6(t^)  :tj  £ T £ *-2^‘  * stochastic  process  {f(t^,t^)  :0  £ t^  i '"2  ^ said  to  be 

2 

L^-adapted  {with  respect  to  8)  if 

(i)  fC'.tj)  is  separable  and  measurable  on  lO.t^l  , t^  £ 0 

(ii)  SCtj^.t^) -measurable,  0 < 

(iii)  f(tj^,t2)  £ L^(n)  < 0 £ tj  £ t^ 

"2 

(iv)  E / jf  (T,t  ) I dr  < «>,  t,£  0. 

0 ^ ^ 

If  conditions  (i)  and  (iv)  are  replaced  by 

(i)'  f(t^,«)  is  separable  and  measurable  on  [t^,«>),  t^  £ 0 


(iv) ' E / |f{t^,T) l^dT  < “,  0 £ tj  £ tj 


then  f is  said  to  be  L -adapted  (with  respect  to  8) ■ 


Ito  [7]  has  defined  the  integral 


/ f(t^,T)d8(T) 


for  L -adapted  processes  f,  and  its  properties  can  be  found  in  any  text  on  stochastic  in- 
tegration. (See,  for  exeunple,  Arnold  [1]  pp.  64-88,  Friedman  15]  pp.  59-72,  Gihman  and 
Sltorohod  [6]  pp.  11-27,  McKean  (9]  pp.  24-29,  McShane  110]  pp.  102-152,  S)corohod  112] 
pp.  15-29.)  We  address  ourselves  to  the  problem  of  defining  a new  stochastic  integral  of  the 
form 


J f(T,t2)d8{T) 


for  L^- adapted  processes  f. 
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J 


To  beqin  with  we  estal)lish  the  following  result  characterizing  L^-adapted  processes. 


Theorem  2. A: 

lA‘t  T di'note  the*  region 

n 

{(!.»...#!  ) :t,  'T<»»«vr  <t_)  ,0^t,  't, 

I n 1—1—  -n  2 -1-2 

2 

For  any  adapted  process  f there  exists  a unique  sequence 

^ I t,  1 

such  that,  for  0 ^ t ^ t^,  the  L^(fi)  expansion 


2 n 


(2.1)  Ef(t 


\>l(  ( “■(  ^n'h'‘2'^ TjdS(T^)...d8(T^.j)d6(T^)  . 


'1  ‘1  '■1 


In  particular,  for  0 < t^, 


(2.2) 


- Ef(tj,t2)  + / i|-(tj,i,t2)de(T) 


where  is  3 ( t ^ , t) -measurable , a.e.  T , and 

1 

e/  |i()(t,T,t)|  ^dt  <<“,  a.e.  Tf|t,tl 

f\  ^ / 12 


(2.  J) 


(2.4) 


e/  U(t^,T,t2)|dT<«>,  . 

^1 


Proof : 

By  considering  the  Brownian  motion 

H*(t)  = B(t j^+t)-B(tj)  , 1 t £ t^  - 

the  expansion  (2.1)  becomes  a form  of  the  homogeneous  chaos,  and  follows  directlv  from 

Theorem  4.2  and  Theorem  5.1  of  Ito  [81.  The  uniqueness  follows  from  Theorem  4.3  there.  The 
2 

fact  that  f is  L^-adaptod  implies  that  for  ^2  — ^ 
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E / / liKt.T.t^)  dT 

0 0 


T.  I j T^t^))  dT  dt 

0 t 


< E / |f (t^t^)!  dt  < 
0 


from  which  (2.3)  follows.  Similarly, 


e/  (4,(t^,T,t2)  l^dT  < e |f(t^,t2)  < » . 


since,  in  general,  nothing  can  be  said  about  the  existence  of  a formal  stochastic 

differential  3^  f(tj^,t2)  (i.e.  t^  is  held  fixed),  it  is  necessary  to  restrict  ourselves 

2 ^ 

to  L^-adapted  processes  f for  which  such  a differential  does  exist.  That  is,  we  require 
that 


(i) 

6 

3ti 

E f (t^,t2 

) exists 

n ■ 

1,2, ..  . 

(ii) 

The 

series 

► T 

oo  2 

3 

3t^ 

E f 

)-!  / / 
n=l tj  t 

converges  in 

(iii) 

•e  (t 
n 

l'*^2''*^l'' 

(iv) 

The 

series 

t T 

to  2 n- 

^i(t 

l,t  ;t  )t 

1/  / 

3t^  ’’n'  1'  2' 


- 1 - 2 


- -1  - '•2' 


- "I  - "2' 


n=2tj  tj 


2 2 . 
converges  in  L (!))  , for  0 i.  t^,  to  an  L^-adapted  process  f'(tj^,t,) 


-6- 


2 1 A 

Such  processes  f are  said  to  be  L ' -adapted  (with  respect  to  B) . The  process  f is 


called  the  derived  process  of  and  we  write 


f (tj.tj)  5 - 


3t  f (t^.tjjdBCt^) 

dT 


In  many  ways  it  behaves  like  a derivative.  For  ex2unple,  if  f is  of  the  form 

f(tj,t2)  • F(B(t2)  - B{t^))  , 0 < tj^  < t^ 


where  F t C (B) , then 


f'Ct^.t^)  - F'(6(t2)  - B(t^))  , 0 1 < tj  . 

2 1 

In  fact,  if  f is  L^’  -adapted,  then  3^  f(tj^,t2)  formally  exists  and  is  given  by 

f°(ti,t2)dti  - f'(t^,t2)dB(tj^) 

So  that  f*  is  simply  the  negative  of  the  diffusion  part  of  it. 

2 1 

We  now  make  the  following  definition.  Suppose  f is  an  L^'  -adapted  process  of  the  form 

t T T 

2 n 2 

f(t,,t,)  - / / •••/  «>(t,,t,;T  .,T  )dB(T,)  •••dB(T  )d8(T  ) 

12'^  ' 121  n 1 n- 1 n 

1 1 'i 


2 ^l'^2 

where  '^(t,,t-)  c L (T  ) , 0 < t,  < t,.  Then 

12  n — 1 “ z 


/ f(T,t2)dB(T) 


is  defined  to  be 


•^2  T ^n  ^2 


/ / / •••/  '^(T^,t2;T2,...,f^,T)d6(Tj^)  •••d6(T^_j^)d6(T^) 


dB(T) 


*^1  *^1  *^1  *^1 


(2.5) 


+ / f'(T,t2)dT  . 


The  first  term  here  exists  since  f is  L^-adapted.  We  note  that 
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i 


(2.6j 


form 


t T T 

2 m 2 


* / / •••/  v-(t  t :T  T )d6(T  )-.-dg(T  )dB(^  ) 

12*''  ^ 121  m 1 m-1  m 


2 

where  m < n and  ) t L (T  ),  0 < t £.t  , then 

— 12  m 1 


2 2 . 

E / f(T,t  )d6(T)/  f(T,t  )dg(T) 


2' 


2 2 2 _ 

El/  f(T,t  )f(T,t  )dT  4 / f'lr.t^ldT/  f‘(T,t2)dTl, 


■2'‘'  ’"2'"  ■ J - ' ' 2' 


(2.7) 


'^2  7n-i  Ti 

/ / •••/  Vl>'^‘"l'‘2'"2 ^ " 


*^1  *^1  *^1 


otherwise 


In  particular. 


*■2  ^2  *"2  , 

(2.8)  E 1/  f (T,t  )d6(T)  1^  = E [/  If (T.t^)  l^dT  4 1/  f'd.t^ldTl^l  . 

h h "l 


Using  the  al)OVe  definition  and  Theorem  2. A it  is  now  desired  to  extend  this  stochastic 

2,1 


integral  to  general  -adapted  processes  f.  To  this  end  the  following  result  is  pre- 

sented . 


Theorem  2.B: 

There  is  a unique  extension  of  the  integral 


/ t(r.t^)dBCr) 
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i 


to  all  L^'^-adapted  processes  f,  satisfying  the  following  continuity  condition: 

Whenever  * 1,2,...}  is  a sequence  of  L^'^-adapted  processes  for  which 


lim  E l|f„(tj,t2)|^  t ^ ' ° 

n^«o 


2 sup 


/ n=l,2 E(|f^(T,t2)|  + |f '(T.t^)  1 IdT  < 


then 


lim  e|/  f^lT.t^ldBd)  1 =0  , 0 t < t . 

n-w»  t^ 

Proof : 

For  the  existence  of  the  integral  it  is  necessary  to  establish  the  L^lSl)  convergence 
of  the  series 


« *^2 


(2.9) 


I ! f (T,t  )d6(T)  , 0 < t < t 

n=l  t,  ^ 


where  f has  the  L <il)  expansion 


f (tj^.t^)  = E f (t,  ,t 


.2,1 


l'"2>  " I/n“l't2>  ’ ° 1^2  ■ 

n=l 

and  f^  is  L*' ‘-adapted  and  of  the  form 
*^2  ^n  ^2 

n'h'*^2‘  = / / •••/  ^n‘h'^2''^ "n> ( T^.^)  dfi  (T^)  , 0 < t^  < t^  , 


1 1 "1 
for  n * 1,2,...  , Here,  as  before 


%<^-’^2’  ^ ^)  - 0 1 tj  1 t^  ; n = 1,2,... 


Consider  first  the  series 

(2.10) 


y/'^ 

f*(t,t. 
n*l ^ n 4 


)dT 
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By  assumption,  the  series 

N 

); 

n-l 

f‘(Tft„) 
n 2 

tends  to  fd.t^)  in  L^(i!) 

for  larqe 

N, 

at  oacli  point  t 

. It,,!^). 

FurthertiKtre 

N 

I 

n-l 

If  “(T,!.,) 

' n 2 

1^1 

E |f ‘(I ,1^)  1^.  1 . 

It^,!^) 

ami,  slnco  f"  is  I.^-adaptod, 


/ F I < 


Tiiua,  by  tho  thoort-m  on  dominated  converqence,  the  scr'es 


N *^2 


n ^ I 


n»  1 t 


tends  to  / E lf'(T,t  ) j^di  for  larqe  N.  I'urthormore , by  tho  rauchy-Schwnrtz  Inequality, 


N *^2 


K|I  / - / f'(T,t2)dTl' 


n-1  t 


and  thus  tho  sorios  (2.10) 


convorqos  to  f f''(T,t^)dT  in  I.  (fl)  . 

t , 


Consider  next  tho  sorios 


(2.11) 


no 

I 

n-l 


q ( t , t ) 
n 1 2 


where 


*2  *nfl  ^2 
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Since  is  L^-adapted  it  follows  that 

"2  ^2 


'^(ti.tj)  - / / ...  / [6(Tj)-6(t^)]«>^{t^.t2:Tj....,T^)d6(T^)...dg<T^_^)d6(T^) 


1 X 


t T 
2 2 n 


■*■///  •••/  16(t  )-6(t)1^  ^ (T,t  ;t, T )dB(T-)  •••d6(T  ,)dB(T)dT 

^ ^ din^i  n 1 n-1  n 

and  thus  by  the  Cauchy-Schwartz  inequality 

^2 

Ehntti.Vl"  < 2(t2-t^)Ellf„(t,,t2)l"  t (t^-t^)/  lf°(x,t2)l''dT]  . 

*^1 

Since  f is  L^-adapted,  the  theorem  on  dominated  convergence  can  be  used  as  before  to  show 


that 


N ^2 


I / E lf°(T,t2) l^dT 


n*l  t. 


tends  to  j E |f  (T.t_)  | dr  for  large  N.  Hence  the  series  (2.11)  converges  in  L^(fl).  And 


now  using  (2.5)  it  follows  that  the  series  (2.9)  also  converges. 

Concerning  the  continuity  condition,  the  estimate 

^2  *^2 
E 1/  f(T,t  )d6(T) 1^  < 2 E 1/  f'(T,t  )dT|' 


+ 4(t2-ti)E  |f(t^,t2) 


+ 4(t2-ti)^E  1/  f°(T,t2)dT| 


shows  that  the  integral  we  constructed  satisfies  this  condition. 


Some  of  the  important  properties  of  this  integral  are  summarized  in  the  following  result. 
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Theorem  2.C: 


Let 


where 


2 , 1 

Lot  f , f.  be  li  -adapted,  and  set 
a b 


I (t,,t  ) - / f (T,t  )ciH(T),  0 < t _<  L 
al2  ^ 2 —1—2 


*^i 


i,b  t R.  Then 


(a)  (Linearity)  / (af^  ( t , t^) +t>f|^(  i , t^)  ld6(  t)  “ al^it^.t^)  *■  blj^(tj,t2) 

2,1  0 

(b)  (Smoothness)  I (t,,t.)  is  L.  -adapted,  and  1=0,  I_  = f 

a 1 2 + a a 


(c)  E I (t, ,t_)  - E / f '(T.t  )dT 
a 1 2 ■'  2 

1 


(d)  E I (t,  ,t,)I.  (t,  ,t  ) 
a 1 2 b I 2 


2 2 2 
El/  f^(r,t2)f^(T,t2)dT  + / fMT.t^ldt/  f^(T,t2)dTl 


+ E / (f  "(T,!  )g  (T,t  ) + f ■ ( t , t )q  ( r , t ) Idx 
^^a  2 b 2 b 2a  2 


E / f (T,t„)  f.  (T,t  )dT 

•'.a  2 b 2 


* E I [f;(T,t2)I^(T,t2)  + fb<^'‘2’'a‘^'^2 


)ldT 


'’a<^'‘2>-/  EfjT^,t2)dp(t^) 


T . , T - 

2 n+1  2 


*111  "•  / ^a,n‘^’'2"2 nx ) ' ' 1 ' ' ’ ‘ ’ n' ‘ 1 ’ 

n»l  T T T 
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d the  functions  **  1,2,...)  are  as  in  Theorem  2. A.  And  g is  defined  analogously. 


In  particular, 


® I V + 1/  f*(T,t  Idrl^l 


2E  / f:(T,t,)q  (T,t,)dT 

1 

*^2  2 *^2 

= e/  |f  (t,t  )|  dT  + 2e/  f-(T,t,)I  (T,t  IdT  . 

¥ ^ ^ a2a2 

1 *"1 


All  four  parts  follow  directly  from  Theorem  2. A,  using  (2.5),  (2.6),  (2.7),  (2.8)  and 
the  observation 


^a<h'^2'  = 'a<ti'^2>  ' / 


I 


and  similarly  for  g . 

b 


§3.  correction  formula 


In  this  section  we  present  the  following 

Theorem  3. A (Correction  Formula): 

2 1 

Let  f be  L^'  -adapted,  and  assume 


/ I f (t,t)  pdt  < <» 


2 t 


e/  / |f(T,t)  1‘^dT  dt  < 


Then 


*^2  ‘2 


/ / f(T,t)de(t>dB(T) 


2 t '-2 

• / / f(T,t)dB(T)d8(t)  + / f{t,t)dt  . 

Proof: 

If  f is  a deterministic  function,  the  result  follows  directly  from  (2.5).  So  let  f 
be  of  the  form 

t ^2 

(3.1)  f(T,t)  * / / •••/  (t  ,t;T  , , . . . ,T  )dB  (t,  ) • • -dB  (t  ,)dB(T  )»  t,  < t < t < t , 

' ' 1 n 1 n-1  n 1 — ~ — 2 

T T T 

where  n > 1.  Then  by  (2.5) 


/ f(t,t)d6{T)  = / / •••/  (t  j ,t;T2»  • • • (t^)  • • -dg  (T^)de 

tj^ 


and  thus 


+ / f-(T,t)dT 
t. 


tilt<_t2  , 
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2 t 

/ / f(T,t)dS(T)d8(t) 


"2  T 


1 1 1 


( ( ( ■"(  Vl>‘^6(T^)...d6(Tjd6(T^^^)dB(T) 

^1 


"2  <=2 


*11  f *(T,t)d6(t)dT 


Next  let 


gd.tj)  - / f(T,t)d6(t)  , t^  £ T < tj  , 


so  that 


*^2  ^n+1 


gd.tj)  - / / •••/  ’'1  - ^ - *"2  ' 

Then  by  (2.5) 

^2  *^2 

J / f (T,t)dB(t)dB(T) 


"1  ^ 


*^2  T ^n+1  ^2 


If!  •••/  v>(t^,t:T2 T^+j)d6(Tj^)  .••dB(T^)d8(T^^j)dB(T) 


-I  n "1 


+ / g*(T,t  )dT 
t. 


Since  f(t,t)  =0  it  is  enough  to  show  that 


g'Ct.t^)  = j f *(T,t)d6(t) , tj^  _<  T < tj  , 


and  this  is  clear  by  inspection.  Thus  the  Correction  Formula  holds  if  f is  of  the  form 


(3.1).  Finally,  using  Theorem  2. A and  the  continuity  condition  of  Theorem  2.B,  it  follows 


2 1 

that  the  Correction  Formula  holds  for  any  -adapted  process  f 


i 

*«d 

i 


-15- 


The  process 


is,  by  Theorem  2.C,  1.^'  -adapted,  and,  as  such,  [xissesses  a formal  differential 

3,.  M(t  ,t  ) . 

1 

However,  it  is  of  greater  interest  to  compute 

since  this  is  an  Ito-dif ferential  (not  just  a formal  notation),  and 


n(ti,t2)  = / 3^r|(tj,T)  . 

*^1 


The  Correction  Formula  can  be  employed  to  this  end. 


Theorem  3.B: 


Let  f be  L^'  -adapted  and  set 


n(t  ,t  ) = / f(T,t  )dBCt)  . 
12^^ 


Suppose 


f(tj,t2)  - f(t^,t^) 


/ a(tj,r)dT  + / b(tj^,T)dp(i),0£t^£t, 


where  a,  b are  L^'  -adapted  processes  satisfying 


T ^2 

e/  / l|a(t  t.)  + |b(t  ,t,)  l^ldt  dt  < oo  , T 2:  0 

0 0 ^ 


/ |b(t,t) I dt  < 
0 
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3t  = [bCt^/t^)  + / a(T,t2)d6(  T)  Idtj 


+ [f(t2.t2)  + / b(T,t2)d6(  t)  )d6(t2)  , 0 i 


Proof : 


The  theorem  follows  directly  from  the  Correction  Formula.  Indeed, 
*^2  T 

/ Ib(T,T)  + J a(T' , T)dg(T' ) IdT 
"l  ^ 

^2  T 

+ / [f(T,T)  + / b(T',T)dB(T')lde(T) 


/ f(T',T')de(T') 

t. 


^2  ^2 


+ / [/  a(T',T)dT  + / b(T'  ,T)d6(T)ldB(T') 

tl 


= / f(T' ,t  )dB(T')  . 


It  is  worthy  of  note  that  although  the  process  (here  tj^  is  fixed) 


x(t)  = / f(T,t)de(T) 


is  not  a martingale,  the  Correction  Formula  does  provide  its  Doob-Meyer  decomposition.  Thus 
if 


f(t^,t2)  = / i|){t^,T,t2)dS(T) 

'^l 
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(cf.  Theorem  2. A),  then 


/ f(T,t)de(T) 


t I 

/ (/  lJ/(T^,T,t)dP(T^)lde{T) 


+ / \J)(T,T,t)dT  . 

t. 


For  example » the  decomposition  for 


6(t)  / f(T)d8(T) 
0 


C * 

/ tB(T)f(T)  + I f(T  )d6(T  )Id6(T)  + / f(T)dT  . 

0 0 0 

As  another  application  of  the  Correction  Formula,  let  l(t)  be  a strictly  increasinq 
differentiable  function  of  t on  with 

(3.3)  A(t)  > t , t^  < t < t2  . 

Suppose  we  were  to  define,  for  f ^ ^ i ^2 ' 


f(T,t)  = 


t < 1(T) 


t > 1(T) 


and  substitute  this  in  the  Correction  Formula.  Then 


/ 6(X(T))d8(T)  + / 8(x’NT))d8(T) 

t.  X(t,) 


8(t2)B(x‘  (t2))  - P(tj)8(X(t^))  . 
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This  is  an  integration  by  parts  formula.  Of  course  the  difficulty  here  is  that  f is  not 
-adapted.  But  in  this  case  (since  f is  deterministic)  the  Correction  Formula  can  be 
verified  directly  from  (2.5).  In  fact,  as  long  as  the  process 

^2 

g(T,t2)  “ / f(T,t)de(T)  , tj^  £ T £ t^  . 

has  a derived  process  g ",  then 
^2 

/ g(T,t  )d6(T) 


2 t '•2 

/ / f (T,t)d3(T)dB(t)  + / g-(T,t  )dT  . 

t,  t,  t. 


Now  we  check  that 


g(T,t,) 


6(A(t))  - 6(T) 


B(t2)  - B(T) 


tj^  < T £ ^"^(t^) 


A (tj)  1 T 1 . 


Because  of  (3.3)  it  follows  that  g'  = 1.  Thus  (3.4)  is  established.  However,  a more  diffi- 
cult question  involves  the  case  where 

(3.5)  A(t)  £ t , 1 t £ t^  I 

and  the  strict  inequality  (3.3)  no  longer  holds.  Here  we  have 


1 - (1  A A'(T)) 


A(t)  # T 


A(t)  * T . 


Thus  we  arrive  at  the  following  extension  of  (3.3). 

A'^tj)  tj 


/ B(A(T))dB(T)  + / 6(a”  (T))dB(T) 

t.  A(t,) 


= 6(t2)B(A  (t^))  - 6(t^)B(A(t^)) 


- / (1  A A’(T))dT 
A 


where  A is  the  set  (t  f It^.t^lsACt)  “ t).  Now  we  merely  note  that 


/ (1  A X' (T))dt  - / dt 


and  we  arrive  at  the  following: 

Theorem  3.C  (Integration  by  Parts)  : 

Let  X(t)  be  a strictly  increasing  differentieible  function  of  t on 

X(t)  ^ t , tj  £ t <_  tj  . 

Let  A be  the  set  {t  £ Itj,t2]:X(t)  » t}.  Then 


X ttj) 

/ 6(X(T))d6(T)  + / 6(x'\T))d6(T) 

tj^  X(tj^) 


actjjBCx  (tj))  - 6(tj)e(x(t^))  - ka) 


where  £ is  Lebesgue  measure. 

Similar  techniques  li)te  those  used  to  establish  Theorem  3.C  can  be  used  to  generalize 
the  Correction  Formula  for  functions  f defined  on 

S - { (T,t)  :Xj^(T)  A <_t  <.  XjCT)  A t^} 

where  Xj»  Xj  satisfy  the  conditions  of  Theorem  3.C,  and  Xj^  ± Xj-  We  merely  extend  the 
function  f defined  on  S to  the  whole  triangle,  i.  ^ i.  ^2'  setting  it  to  zero 

on  the  complement  of  S.  The  reader  can  chec)t  that 

//  f(T,t)d6(t)dB(T) 


//gf(T,t)d6(T)dB(t)  + /^f(t,t)dt 


A - S n { (T,t)  !T  » t)  . 


§4.  CARATHEODORY  PRINCIPLE 


A particularly  interesting  class  of  stochastic  processes  are  those  of  the  form 
flt^.t^)  = ♦(t^.tj,  Slt^)  - B(tj))  , 0 _<  t^  t^  • 


The  conditions  for  f to  be  L^-adapted  are 


(4.1) 


(4.2) 


- 2(t  -t  ) 

/ |*(tj,t^,x)  I e dx  < " , 0 tj  ^ t^ 


- *^2  |^(T,t  ,x)  1^  ■ 2(t  -T) 

j j c dTdx<<“,t.,^0. 


-a»  0 '^^2''  ^ 


2 - 


2 1 

And  the  conditions  for  f to  be  -adapted  are  that  the  functions 

2 

^*(tj.t2,x)  , (^.i^)*,tj,t^,x) 

1 3x 

also  satisfy  (4.1)  and  (4.2).  For  such  processes  f the  integral 

^2 

/ f(T,t  )dB(T) 


can  be  related  to  an  Ito  stochastic  integral.  In  fact  wo  have  the  following  result; 
Theorem  4. A (Caratheodory  Principle): 

l«t  f be  an  -adapted  process  of  the  form 


f(tj,-,)  = I;(tj,t2,6(t2)  - p(tj))  , 0 < tj  < t^  . 

Then 


whore 


/ f(T,t2)d8(t)  = F(t^,t2,(l(t2))  . 0 1 


F(tj^,t2,x)  - / 41(1, t^.x  - t!(T))d6(i)  , 0 ^ tj  £ t^  : X t R 
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The  proof  relies  on  the  following  two  lemmas. 


Let  be  the  Hermite  polynomial  of  degree  n,  where  n ^ 1.  And  let  be 


differentiable  in  and  satisfy 


/ ijaCT/t^)!^  + |*~  a{T,t2)  l^ldx  < «>  , ^ 0 


/ a(T,t  )H  (t  -T , B(t  ) -B(t) ) d6 (t) 
2 n 2 2 


^ ^ ^ ^ a(T,t2)H^^^(t2-T,6(t2)-8(T))dT 

*^1 


+ n / a(T,t2)H^_j^(t2-T,6(t2)-6{T))dT  , 0 1 


Lemma  II : 


Theorem  4. A holds  for  functions  <|>  of  the  form 


where  a satisfies  the  conditions  of  Lemma  I. 


Proof  of  Lemma  I: 


The  proof  relies  on  the  fact  that 


^Hn(Vti,6(V-6(V) 

*^2  "n  "2 


f / •••/  d6(T,)  •••d6(T  ,)d6(T  ) , n ■=  1,2, 

' ' ' 1 n-l  n 


These  polynomials  are  defined  by  ^ 2 

X ^ x_ 

H (t,x)  = (-t)"  e , n - 0,1,...  ; t > 0;  x f R . 

" 3x" 
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(A  very  short  proof  of  this  result  appears  in  McKean  19)  p.  37.)  Thus,  by  (2.5) 


1 2 

^ / a(T,t2)H^(t2-T,6(t2)-P(T) )d6(T) 


*^2  ’n  + 1 ^2 


/ / •••/  a(T,,t  )d6(T,)  •••df)(T  )d6(T  ,) 

t f ► 12  1 n n+1 


^1  ^ 


*^2  ^n-1  ^2 


t/  a(T,t  )/  / .../  dS(T,) ■••dB(T  ,)d6(T  ,)dT 

t.  T T , 1 ''-2  n-1 


‘2  ^ntl  ^2 


d6(T, ) • • "dgCT  )dB(T  ,) 
*■  *.  *.  A n n+1 


*"1  ^1 


^2  'n+1  '2 


+ / ^aCt.t^)/  / .../  dB(T  ) •..d6(T  )dp(T  ^,)dT 

t . T T ^ ^ ^ 


^2  'n-l  '2 


t / a(i,t  )/  / .../  dB(T  ).-.dB(T„  ,)dB(T  ,)dT 

t T T , I f''2  n-1 


o^rrrr  '“S'‘2’"n+i'V'i'f*<'2>-p<'i'> 


^ TlrnTT  / i7  ^<'''2>''n+l‘*^2-'’B‘*^2''f'<'>>‘^' 


1 2 

* U;-Y)  ! / a(T.t2)H^_^(t2-T,B(t2)-B(T))dT 


from  which  the  desired  result  follows. 


Proof  of  Lemma  II: 
Let 


♦^(t 


l't2'’‘) 


aCtj^.t^lc 


XX  - - 


<VS> 


1 »1  i ^2 


X.x 


i 
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Than  (ovaluat#  tho  tntaqiall) 


H(T)  )clB(i) 


+ Xj  j't  ) )i3i 


, S , Mx-P(i)l  - ~ 

If  3 . ^ ^ ^ di  , 0 < t ,•  t .,  i X . K 

*"  I • 


♦x  / 


and  thus 


♦ x/  ♦j^(t2-T,8(tj)-P(T))dT 


, ‘2  , X|p(t,)-8(i)  1 - \ x^(t  -1) 

* X / F «<''‘^2»<-  - *1  ' '■>  ■ 


On  tho  othor  hand. 


♦ x'^i-^a'’*’  " I nr  *‘S'‘2'”n'S-S'’'’  • "'-*1  " 

n*0 


and  thua,  by  lonrna  I, 
t. 


/ ♦j^(T,tj,6(tj)-8(i))d6(t) 


- i ♦^(tj.tj.P(t2)-8(tj))  - j 


1 


Xl8(t,,)-K(i)  1 - I V^(< 

)(o  ^ ^ ^ -ltd> 


♦ x/  ♦j^(tj-t,P(tj)-8(\))di  , 0 ^ . 
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I 1 
I i 


L 


r 


And  from  this  it  follows  that  Theorem  4. A holds  for  ^ that  is. 


/ 't';^(t2-T,6(t2)-6(T))dS(T)  = 

*^1 


) , 0itj<t2:XeR  . 


By  differentiating  this  equation  n times  with  respect  to  X,  and  setting  X = 0,  it 
follows  that  Theorem  4. A holds  for  the  function 

iXt,  ,t  ,x)  = a(t,,t_)H  (t.-t,  ,x)  , 0 < t,  < t_  : X c R . 

12  12n21  —1—2 

■ 

Now  we  are  in  a position  to  present  the 
Proof  of  Theorem  4. A: 

Let  ip  satisfy  (4.1).  Then,  because  of  the  completeness  of  the  Hermite  polynomials 
there  exists  a unique  sequence  ' ^2*  = 0,1,...  ; 0 ^ t^  ^ t^  such  that 

00 

♦‘ti't^.x)  = I a„(t^,t2)H_^(t2-tj,x)  , 0 < t^  < t^  ; X . R 

n=0 


in  the  sense  that 


N-«*»  .00 

Furthermore,  since 


7 ^ 

lim  / U(t  ,t  ,x)  - y a (t  ,t  )H  (t^-t.  ,x)  Te 

KT-Wn  rr>  _nl2n2l 

M-Wir.  _on 


2'VS> 


dx  = 0,0^tj^j^t2  . 


— H (t,x)  = n H , (t,x)  , n = 1,2, .. . ; t ^ Oj  x < R 
dX  n H”  1 — 


it  follows  that  if  satisfies  (4.1) 


then 


♦(tl'tz'X)  = I .0<t^<t2;xcR 

n=0 


in  the  same  sense.  Finally,  since 

.2 


3 13 

(—  ■ T — :7)H  (t,x)  = - n(n-l)H  .(t,x)  , t > 0;  x c R 
dt  2 2 n n”2 

3x 


3 la 

It  liltewxse  follows  that  if  + 2 "2' **^1 ' *'2 S'^tisfies  (4.1)  then 

“^1  ax 
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± .13 

‘at 


0 .<  t^  < t^  ; 3(  c R 

in  the  same  sense. 

Now  we  define  for  n = 0,1,... 

^n<^'"2>  = ^‘^'‘^2'“n<VS'e<V-8<^>>  - « 1 ^ 1 . 

Because  of  (4.2)  and  the  continuity  condition  of  Theorem  2.B  it  follows  that,  for 


0 1 ti  < t^. 


N ^^2 


I j f^(T,t2)de(T) 


n®0  t 


r 2 

tends  to  j f(T,t_)dB(T)  in  l for  large  N.  Furthermore,  if 


Fn(ti,t2,x)  = / a„(T,t2)H^(t2-T,  x-B(T))d6(T)  , 

*^1 


n = 0,1,...  ; 0 tj^  ^ t^ 


then 


I fn(t^,t2,x) 

n=0 


tends  to  F(tj,t2,x)  in  L (0),  in  the  sense  that 


- N 2(t  -t  ) 

lim  / E IrCt  ,t  ,x)  - y F (t  ,t  ,x) 1 e ^dx=0,0<t,  <t 

„ ' ' 1 2 n 1 2 ' 

N^Ko  -00  n=0 


- 1 - 2 


“ N 2(t  -t  ) 

lim  / E lXp.,t^,t^,x)  - I ^F„(ti,t2,x)|2e 

N-oa,  -CO  n»0 


dx  = 0 , 0 ^ tj^  £ t^ 


Since  these  conditions  imply  that 


I F„(t  t^.BCt^)) 
n-0 
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tends  to  F(tj^,t2, 8(t2) ) in  L (SI)  for  large  N,  0 i ^ t^.  and  since,  by  Lemma  II, 
for  n « 0,1,... 

^2 

I f^(T.t,)d8(t)  = F^(t, ,t,,8(t,))  , 0 < t < t,  , 

'n  2 nl2  2 —1—2 


the  proof  of  Theorem  4. A is  complete. 

As  a corollary  of  Theorem  3.B  we  present  the  following  result. 
Theorem  4 . B : 

Let 


nStj^.t^)  = / - 6(T))d8(T) 

*^1 


where 


2 2 

♦ (ti,t2,x),  ♦(t^,t2,x),  + |-^)*(t^,t2,x),  + J -4-H(t  .t  ,x) 

1 3x  2 3x 

satisfy  (4.1)  and  (4.2).  Then 

3t  n(tj^,t2)  = [♦(t2,t2,0)  + / 't’(i-t2,8(t2)  - 8(T))d8(T)ld6(t2) 


* ^'k  '<'<t2.t2,0)  + / (-^  + i -^)(^(T,t2,6(t2)  - 6(T))d6(T)ldt2  , 0 < t^  < t^ 


t 2 3x 


Proof : 

The  result  follows  directly  from  Theorem  3.B  once  we  observe  that,  by  Ito's  Formula, 
3t  <Kt^,t2,8(t2)  - 8(t^)) 


♦ (t,,t,,8(t  > - 6(t,))de(t,)  + (^  + i -^)'l>(t,  ,t,,8(t,)  - B(t,))dt^  . 


3x  1 2'  2 


2 3^2  2 3^2''^'  1'  2'^'  2'  ‘'1"“2 
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55.  ITO-VDLTEJWA  EgUftTIOW 


In  this  section  we  study  the  behavior  of  the  solution  to  the  problem 

t t 

(I-V)  C(t)  - / o(T,t)  e(T)dB(T)  - / b(i,t)  r,(T)dT  - F(t) 

0 0 

where  o>  b,  F are  functions.  A more  general  class  of  equations  is  analyzed  in  Berger  [21 , 
(31)  but  to  make  this  exposition  self-contained,  the  existence-uniqueness  results  for  (I-V) 
are  presented  here. 

Theorem  5. A: 

Let  O'  b,  P be  functions  satisfying 

= I|o|It  < ” 

^ iim  T < » 

of  (I-V)  on  10, T1  for  any  T 0 

< 

Furthermore,  if  {(t)  is  another  solution  of  (I-V)  satisfying  (5.1) , then  E is  a version 
of  e. 

Proof I 

To  establish  existence  we  construct  the  successive  approximates  to  (I-V) . Thus  let 

^^(t)  - F(t)  , t > 0 

t t 

(5.2)  t (t)  - F(t)  + / o(T,t)E  ,(T)dS(T)  + / b(T,t)E  (T)dT, 

n '(j  n-1  n-i 

n - 1,2, ; t > 0 . 


0 < t ^<^t  < 


0 H ))f)4  < 


for  each  T ^ 0.  Then  there  exists  a solution  ^(t) 
such  that 


(5.1) 
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The  first  property  of  these  iterates  we  establish  is 


0 <T<  T ® < » , n = 1,2,...  ; T > 0 . 


This  is  shown  by  induction  as  follows. 


/t"<  T ^ l5n<^'  l'  i ^II^IIt  ^ 0 /r.  T = U„-l<t)  1^  T > 0 


- 0 < t^<  T^/  |b(Tft)  l^dr]  , T ^ 0 

- - 0 0 


The  next  property  we  establish  is 


o o (2M^) 

0 <T<  T *=  l^ntl<">  - ^ ^ i ° 


Mt  = ^ ^I1‘>Ht  • 


This  is  shown  by  the  following  observation 


2 t 

l^n+l'’"’  ■ 1 = Un(T>  - en_l(T)  I dT,  n = 1,2,...  : 0 < t < T . 


2 

Thus,  by  (5.4),  for  each  t c [0,Tl , the  sequence  converges  in  L (fi)  to  a random 

variable  C(t).  The  process  is  5(0,t)-measurable  and 


T<  T®  - ?(t)|^  = 0 


taking  limits  in  (5.2)  is  valid,  and  ^(t)  is,  therefore  a solution  of  (I-V). 


To  establish  uniqueness  let  C(t)  and  C(t)  denote  two  solutions  of  (I-V)  satisfying 


(5.1).  Then 


r 
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U(t)  - l(t)  I < 2M  / E |e(T)  - C(t)  l^dT 


E |f.(t)  - f,(t)  I = 0 , t > 0 . 


The  successive  approximates  (5.2)  are  particularly  interesting  in  view  of  the  Correction 
Formula.  In  fact  the  solution  to  (I-v)  can  be  represented  as  an  adapted  stochastic  integral. 
This  is  the  content  of  the  following 
Theorem  5.B  (Resolvent  Formula) : 

Let  Of  b,  F be  as  in  Theorem  5. A,  and  also  satisfy 


0 < tj  < t^  < T ' Igt"'  I * ^3^1  I ^ < “ , T ^ 0 


sup  |d  „,,,|2 

0 < t < T Ut  ^ I < « , T 0 . 


Define  the  iterates  g , b as  follows- 
n n 


a^lt^.t^)  = , b^ltj.tj)  > bft^.t^)  , 0 < < tj 


°n+l‘*^l'''2’  " ^ o^(tj,T)o(i,t^)de(T)  + / o^(tj,T)b(T,t2)dT  , 


^ z 

‘’n+l‘*^l'*'2’  ' ^ t>n(tj,T)o(T,t2)d6(T)  -t  / b^(t^,T)b(T,  t^ldi  , 

t , 


n = 1,2,  . . . ; 0 t^  < t^ 


Then  the  resolvents 


2, 1 

exist  and  are  -adapted  processes.  Furthermore  the  solution  to  (I-v)  is 


-30- 


(5.7) 


C(t)  = F(t)  + / r (T,t)F(T)d6(T) 


+ / [r  (T,t)  - a(T,T)r  (T,t))F(T)dT  , t 0 . 


Proof : 

This  result  is  actually  a corollary  of  Theorem  5. A.  Indeed,  by  the  Correction  Formula, 
it  follows  that  the  successive  approximates  ^ are  given  by 


(5.8) 


t n 

£ (t)  = F(t)  * ! I I o (T,t)lF(T)d8(T) 


t n n-1 

■ I ■ 0(t,t)  y 0 (T,t))F(T)dT 

0 1^=1  " )(=1  " 


n = 2,3...  ; tj^O  . 

Thus  the  convergence  of  the  approximates  implies  the  existence  of  r , r . The  conditions 

0 b 

(5.5)  and  (5.6),  together  with  the  continuity  condition  of  Theorem  2.B,  allow  us  to  take  limits 
in  (5.8). 

■ 

Actually,  because  of  the  restrictive  l”  assumptions  on  a,  b,  the  convergence  of  the 
approximates  is  almost  sure  convergence.  This  is  because  there  exists  a function  C(t) 

such  that 


(t)  I 


c”(t) 


t > 0 


This  is  actually  the  content  of  (5.4).  And  thus  the  series 

00 

I '’'|5ntl<t>  - 

n=l  n 

converges  for  t 0.  So  that  by  the  Borel-Cantelli  Lemma,  £ (t)  converges  almost  surely 
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for  each  t ^ 0.  Similarly 
of  the  terms  in  (5,8) . And 
For  examples  concerning  the 
about  the  solution  of  (I-V), 
reader  is  referred  to  Berger 


the  conditions  (5.5)  and  (5.6)  imply  the  almost  sure  convergence 
thus  the  Resolvent  Formula  provides  tra jectory-type  information, 
use  of  the  Resolvent  Formula,  and  for  additional  information 
and  for  the  case  where  a,  b,  F are  processes  themselves,  the 
12),  13]. 
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